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(57) Abstract 

A relatively low resolutioa touch screen system 
is utilized in a graphic display environment wherein 
the resolution of the graphic display is relatively 
high. The character resolution yields a low target 
resolution, a single character being the target (or the 
desired character). The method zooms a predetemined 
number of characters around an initially reported 
position into a zoom window, the zoom window 
bong an area of the display screen relative to the 
initially reported position, the center of the zoom 
window displaying a curaor character. The zooming 
increases the character resolution snch that target 
resolution is decreased to a value resulting in a touch 
screen resolutioa at least equal to or higher than 
resolution of the target rescHution. Further, as the 
stylus is moved toward the desired character, a new 
center position of the data to be displayed in the 
zoom window is calculated, the new center position 
following the pointer element at a predetermined speed. 
When the desired character is over the cursor, the 
pointing element iswitbdrawn, the current posidon of 
the pointing element utilized to identify the position 
of the desired character, and thus the desired character 
itself. 
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A METHOD FOR UTILIZING A LOW RESOLUTION TOUCH SCREEN 
SYSTEM IN A HIGH RESOLUTION GRAPHICS ENVIRONMENT 

BACKGROUND OF THE INVENTION 

The present invention relates to graphic display systems, and more particularly, to 

5 a method for utilizing a touch screen system having a relatively low resolution in a 

relatively high resolution gr^hics environment. 

Presentiy, touch screen systems are utilized which allows direct information input 

to an information processing ^paratus from a coordinate position on a display screen by 

pointing out a desired position on a display of a cathode ray tube (CRT) display device (or 

1 0 some other like device). This technique is well accepted and has become the accepted 

standard for process operator interaction today. However, this technology utilizes a low 

resolution infrared LED touch screen with a resolution of 127 by 95 to select targets on a 

display with a resolution of 640 by 448. Even though the touch screen resolution is lower 

than that of the display, selecting targets was not a problem since the minimum target size 

15 is 8 by 8. This results in a target resolution of 80 by 56 which is less than the resolution of 

the touch screeiL 

However, when higher resolution displays are utilized, such as a display having a 
1280 by 1024 resolution for example, the resultant target resolution is 160 by 128. Thus, 
targets on this high resolution display cannot be selected directiy with the current touch 

20 screen resolution. The invention described in the related application identified above 
describes a system that zooms up the area aroimd the immediate touch area. This 
technique works well except when the data immediately under the touch area is changing 
dynamically. When this situation occurs, the new data cannot be drawn because the 
zoomed up data covers where the new data should be drawn. 

25 The present invention is an improvement to the invention identified in the related 

applications section above and corrects this condition. 

SUMMARY OF THE INVENTnON 
Therefore, there is provided by the present invention, an improved method for 
utilizing a low resolution touch screen with a high resolution graphics display. A method 
30 of the present invention selects a charactar being displayed on a display using a pointer 
element The display has a first resolution and a touch screen system associated with the 
display has a second resolution. The character has a third resolution resulting in a target 
resolution, such that the target resolution is higher than the resolution of the touch screen 
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S3^stem. The touch screen system transmits to a data processing unh processing 4^ 
display, an X and Y coordinate signal of the character pointed to. The method comprising 
the steps of» when a character is pointed to, accepting an initial X and Y coordinate value 
fiom tiie touch screm system, and calculating a corresponding X and Y coordinate value 
5 of the display. Then the initial X and Y coordinate values and the corresponding 

calculated X and Y coordinate values are saved. The display is zoomed a predetemiined 
nurnber of characters around the initial X and Y coordinate values into a zoom window, 
fte zoom window having a predetemiined size and having a predetermined location 
relative to an initial entry point of the pointer element. If the character to be selected is not 

1 0 over a cursor, the cursor being displayed in the center of the zoom window, the pointer 

elemmt is moved towards the character to be selected, otherwise the pointer is withdrawn. 
Updated X and Y coordinate position values of the pointer element is continually 
accepted on a periodic basis. A new center point of the display in the zoom window is 
calculated, the new center point following the pointer element at a predetemiined speed 

1 S with respect to the speed of die pointer element, loomed display data around the new 

center point is displayed in the zoom window. The pointer is moved towards the character 
to be selected and the method is repeated until the character to be selected is in the center 
of the zoom window, i.e., in proximity or coincident with the cursor. Then the pointer 
element is withdrawn, the new center point calculated previously having the X and Y 

20 coordinate values of the character to be selected, thereby permitting a desired character to 
be selected when the target resolution is higher than the resolution of the touch screen 
system. 

Accordingly, it is an object of the present invention to provide a method for 
utilizing a low resolution touch screen with a high resolution graphics display. 
25 It is another object of the present invention to provide a method for utilizing a low 

resolution touch screen to select a character of a display whereby the display has a 
relatively high resolution. 

It is still another object of the present invention to provide an improved method for 
utilizing a low resolution touch screen to select a character of a display, the display having 
30 a relatively high resolution, such tiiat dynamically changing data within the zoomed area is 
displayed. 
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These and other objects of the present invention will become more apparent when 
taken in conjimction with the following description and attached drawings, wherein like 
characters indicate like parts, and which drawings form a part of the present application. 
BRIEF DRSCRTPTTON OF TH E DRAWINGS 
5 Figure 1 shows a block diagram of a process control system of the preferred 

embodiment in which the present invention is utilized; 

Figure 2 shows a block diagram of conmion elmients of each physical module of 
the process control systmi of Figure 1; 

Figure 3 shows a functional block diagram of a typical physical module of the 
1 0 process control system; 

Figure 4 shows a partial, functional block diagram of the existing system and the 
opened system of the preferred embodiment; 

Figure 5 shows a fimctional block diagram of an open operator station of the 
preferred embodiment; 

1 5 Figure 6 shows a block diagram of a graphics card of the preferred embodiment of 

the universal station; 

Figure 7, which comprises Figures 7A and 7B, shows examples of screen displays 
of the display imit of the process control system; 

Figure 8 shows an overview of the operation of the method of the present 
20 inventioi^ 

Figure 9, (which comprises Figure 9A and 96,) shows a flow diagram of the logic 
of the graphics card 1 SO for implementing the method of the present invention; 

Figure 10 shows an example of display in the zoom window which follows the 
stylus (or pointer) at half speed (or half distance); 
25 Figure 11, which comprises Figures 1 1 A and 1 IB, shows a flow diagram of the 

event handler logic of a co-processor of the open operator station of the preferred 
embodiment of the present inventioi^ 

Figure 12 shows a partial display screen lowing a partial row of characters with 
the corresponding display pixel value and beam of the touch screen system; and 
30 Figure 13 shows a partial expanded character display of Figure 12 according to the 

method of the present invention. 
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DETAILED DESCRIPTION 
Before describing the method of the present invention, it will be helpful in 
understanding a system environment in ^^iiich the invention is utilized. Referring to 
Figure 1, there is shown .a block diagram of a process contix)l system 10 of the preferred 
5 embodiment in which the present invention can be found. The process control system 1 0 
includes a plant control netwoik 1 1 , and connected thereto is a data highway 12, which 
permits a process controller 20' to be connected thereto. In the present day process control 
system 10, additional process controllers 20' can be operatively connected to the plant 
control network 1 1 via a corresponding highway gatew^ 601 and a corresponding data 

10 highway 12. A process controller 20, an inter&ce apparatus vMch includes many new, 
additions, improvements, and features over the process controller 20', is operatively 
connected to the plant control network 1 1 via a universal control network (UCN) 14 to a 
netwoik into&ce module (NIM) 602. In the preferred embodiment of the process control 
system 10, additional process controllers 20 can be operatively connected to the plant 

IS control network 1 1 via a corresponding UCN 14 and a corresponding NIM 602. The 

process controllers 20, 20' interface the analog input and output signals, and digital input 
and ou^ut signals (A/I, A/O, D/I, and D/O respectively) to the process control system 10 
from the variety of field devices (not shown) of the process being controlled which include 
valves, pressure switches, pressure gauges, thermocouples,.... 

20 The plant control network (or more simply network) 1 1 provides the overall 

supervision of the controlled process, in conjunction with the plant operator, and obtains 
all the information needed to perform the supervisory function, and includes an interface 
with the operator. The plant control network 1 1 includes a plurality of physical modules, 
which include a universal operator station (US) 122, an application modide (AM) 124, a 

25 history module (HM) 126, a computer module (CM) 128, and duplicates (backup or 

secondary) of these modules (and additional types of modules, not shown) as necessaxy to 
perform the required control/supervisory function of the process being controlled. Each of 
these physical modules is operadvely connected to a local control network (LCN) 120 
which permits each of these modules to communicate with each other as necessaiy . The 

30 NIM 602 and HG 601 provide an interface between the LCN 120 and the UCN 14, and the 
LCN 120 and the data highway 12, respectively. 
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Physical modules 122, 124, 126, 128,.- of network 1 1 of the preferred 
embodiment are of various specialized functional types. Each physical module is the peer, 
or equivalent, of the other in terms of right of access to the network's comrnunication 
medhmi, or LCN 120, for the purpose of transmitting data to other physical modules of 
S network 11. 

Universal operator station module (US) 122 of network 1 1 is a work station for 
one or more plant operators. It includes an operator console v/idch is the int^face 
between the plant operator, or operators, and the process or processes of the plant for 
which 1h^ are responsible. Each universal operator station module 122, is coimected to 

1 0 the LCN 1 20, and all communications between the universal operator station module 122, 
and any other physical module of netwoik 1 1 , is via the LCN 120. Universal operator 
station module 122 has access to data that is on the LCN 120 and the resources and data 
available through, or finm, any of the other physical modules of network 1 1 . The 
universal station module 122 includes a cathode ray tube display (CRT) (not shown) 

1 S \^iiich includes a video display generator, an operator keyboard (KB) (not shown), a 
printer (PRT) (not shown), and can also include (but not shown) a cartridge disk data 
storage device, trend pen recorders, and status displays, for example. 

A history module (HM) 126 provides mass data storage c^ability. The history 
module 126 includes at least one conventional disk mass storage device sudi as a 

20 Winchester disk, which disk storage device provides a large volume of nonvolatile storage 
capability for binary data. The types of data stored by such a mass storage device are 
typically trend histories, event histories, ....or data fix>m which such histories can be 
determined, data that constitutes or forms CRT type displays, copies of programs for the 
physical modules ^ 

25 An application module (AM) 124 provides additional data processing capability in 

support of the process control functions performed by the controllers associated with the 
process control subsystem 20, 20' such as data acquisition, alarming, batch history 
coUection, and provide continuous control computational fiicilities viien needed. The data 
processing capability of the sqjplication module 124 is provided by a processor (not 

30 shown) and a memory (not shown) associated with the module. 

Computer module (CNf) 1 28 uses the standard or common units of all physical 
modules to permit a medium-to-large scale, general purpose data processing system to 
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communicate with other physical modules of network 1 1 and the units of such modules 
over the LCN 120 and the imits of process control subsystems 20, 20* via the highway 
gateway module 601, and the NIM 602, respectively. Data processing systems of a 
conxputer module 128 are used to provide supervisory, optimization, generalized user 
5 program preparation and execution of such progran:is in higher level program languages. 
Typically, the data processing systems of a computer module 128 have the capability of 
conmmnicating with other such systems by a communication processor and 
communication lines. 

The local control network 120 (LCN) is a high-speed, bit serial, dual redundant 

1 0 communication networic that interconnects all the physical modules of plant control 

network 1 1 . LCN 120 provides the only data transfer path between the principal sources 
of data, such as highway gateway module 601, application module 124, and histoiy 
module 126, and principal users of such data, such as universal operator station module 
122, computer module 128, and application module 124. LCN 120 also provides the 

1 5 communication medium over which large blocks of data, such as memory images, can be 
moved from one physical module such as history module 126 to universal station module 
122. LCN 120 is dual redundant in that it consists of two coaxial cables that permit the 
serial transmission of binary signals over both cables. 

Referring to Figure 2, there is shown a block diagram of the common elements of 

20 each physical module of the network 1 1 or the process control system 1 0. Each of the 
physical modules includes a module central processor unit 38 and a 
module memory 40, a random-access memory (not shown), and such additional controller 
devices, or units (not shown), which are configured to provide the desired functionality of 
that type of module, i.e., that of the operator station 122, for example. The data- 

25 processing capabilities of each module's CPU 38 and module memory 40 create a 
distributed processing environment which provides for improved reliability and 
perfomiance of network 1 1 and process control system 10. The reliabUity of network 1 1 
and system 10 is improved because, if one physical module of networic 1 1 fails the other 
physical modules will remain operational. As a result, network 1 1 as a whole is not 

30 disabled by such an occurrence as would be the case in centralized systems. Performance 
is improved by this distributed environment in that throughput and fast operator response 



wo 94/29788 PCT/US94/06755 

7 

times resuh fix«n the increase computer processing resources, and the concurrency and 
parallelism of the data-processing capabilities of the $ystem. 

As mentioned above, eadi physical module includes the bus interface unit, BIU, 
J2^which is connected to the LC3^ 120 by Ae transceiver 34. Eadi physical module is also 
5 provided with fte module bus 36 wdiich, m the preferred embodiment, is capable of 
transmitting 1 6 bits of data in paraUel, between the module CPU 38 and the module 
memozy 40. Other units, utilized to tailor each type of physical module to satisfy its 
iimctional requirements, are operatively connected to module bus 36 so that each such unit 
can communicate with the other units of the physical module via its module bus 36. The 

10 BIU 32 of the physical module initiates the transmission of data over LCN 120. In the 
preferred embodiment, all transmissions by a BIU 32 are transmitted over the coaxial 
cables vAich, in the preferred embodiment, form the LCN 120. 

Referring to Figure 3 there is shown a functional block diagram of a typical 
ph3^ical module 122, 124, 126, 128 of the plant control network 11, and includes the bus 

1 5 interface unit (BIU) 32 and the transceiver 34, which cormects BIU 32 to the LCN 120. 
BIU 32 is capable of transmitting binary data over LCN 120 and of receiving data from 
LCN 120. Transceiver 34 in the preferred embodiment, is transfonner coupled to the LCN 
120. In the preferred embodiment, the LCN 120 is a dually redundant coaxial cable with 
the c^ability of transmitting bit serial data. BIU 32 is provided with a very fast micro- 

20 engine 56. In the preferred embodiment, micro engine 56 is made up of bit slice 
components so that it can process eight bits in parallel, and can execute a 24 bit 
microinstruction from its programmable read only memory (PROM) 58. 

Signals received from the LCN 120 are transmitted by transceiver 34 and receive 
circuitry 52 to receive FIFO register 54. Micro engine 56 examines the data stored in 

25 FIFO register 54 and determines if the information is addressed to the physical module. If 
the data is an information frame, the received data is transferred by direct memory access 
(DMA) write circuitry 66 by conventional direct memory access techniques to the physical 
module memory unit (MMU) 40 over module bus 36. 

Communication between MCPU processor 68, a Motorola 68020 microprocessor 

30 in the preferred embodiment, and other functional elements of MCPU 38 is via local 
microprocessor bus 39. Module bus inter&ce element 41 provides the conunxmication 
link between local bus 39 and module bus 36. Processor 68 executes instructions fetched 
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fiom either its local mmiory 43, in the preferred embodiment an EPROM, or from MMU 
40. Processor 68 has a crystal controlled clock 45 which produces clock pulses, or timing 
signals. Ii^ut/output (I/O) port 49 provides communication between MCPU 38 and 
equqsmmt external to tiie physical module to permit pr ogr am loading, and the diagno^ of 
5 errors, or &ults, for exanq>le. 

Each MCPU 38 includes a timing subsystem 48 which, in response to clock 
signals fiiom module clock 45 produces firie resolution, synchronization, and real-time, 
timing signals. Any timing subsystem 48 which is provided with a timing subsystem 
driver 50, has the capability of transmitting timing information to other physical modules 

1 0 over the LCN 1 20. Another input to each timing subsystem 48, is timing information 

which is transmitted over LCN 120 and which is received through transceiver 34, timing 
receiver 55 and timing driver 57 of BIU 32. Timing pulses from module power supply 59 
w^iich are a function of the frequency of the external source of A.C. electric power applied 
to power supply 59 are used by timing subsystem 48 to correct longer term frequency drift 

15 of the clock pulses produced by clock 45. 

Additional information of the BIU 32 can be found in U.S. Patent No. 4,556,974. 
A more detailed description of the process control system 10 can be had by referring to 
U.S. Patent No. 4,607,256. Additional information of the individual, common, fimctional 
blocks of the physical modules can be had by reference to U.S. Patent No. 4,709,347, all 

20 of the above-identified patents being assigned to the assignee of the present application, 
and additional informadon of the process controller 20' can be had by referencing U.S. 
Patent No. 4,296,464. 

The addition of an interface apparatus which interfaces other systems to the 
{)rocess control system 1 0 described above and a modification to a graphics generator in 

25 the US 122 opens up the existing system, specifically the graphics mterface, which 
includes designing in the capability to readily permit nodes of differing designs to 
conmiunicate to the network, and will now be described. 

Referring to Figure 4, there is shown a partial functional block diagram of the 
existing system and the open (or opened) system. The imiversal operator station (US) 122 

30 is coupled to a co-processor 200, and the co-processor is coupled to an open system, i.e., 
interfaces/protocols of differing design, including task control program^terface protocol 
(TCP/IP), open system mterfece (OSI), DECnet (a product of the Digital Equipment 
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Corporation of Maynard, Massachusetts),.... The universal station 1 22 is also connected to 
the LCN 120 as described above. Thus, the new universal operator station (open US) 1 23 
includes the US 122 as described above in conjunction with the co-processor 200. The 
purpose of the open US 123 is to open the grsphical interface to the open systems and to 
5 provide information fiom the closed US to the open systems. The co-processor 200 is 
structured to permit the inter£u:e to other systems, i.e., the open systems without 
jeopardizing the integrity of the existing system. The co-processor 200 of the preferred 
embodiment is a Motorola 68040 microprocessor which is executing the UNIX opCTating 
systems (UNIX is an operating system of the American Telephone and Telegraph 
1 0 Company, ATT,.is readily available and is well known to those skilled in the art), and is 
sometimes referred to as a UNIX co-processor. 

Referring to Figure 5, there is shown a functional block diagram of the open 
operator station 123 of the preferred embodiment The operator station 122 as described 
above includes the BIU 32 cormected to the module bus 36, the module memory 40, and 
15 the module CPU 38, both also cormected to the module bus 36. These basic functional 
blocks are contained in all the physical modules. Additional fimctional blocks added to 
die physical module is what gives the physical module its personality apart from any other 
physical module. The operator station 122 includes a graphics card 1 50 which interfaces 
with a display (CRT) and a keyboard (KB) 151, 153. A shared memory 202 is included 
20 and is also cormected to the module bus 36 wMch provides for communication between 

the co-processor 200 and the US physical module 122 (thereby providing communication 
to the rest of the process control system 10 via the module CPU 38). Thus, the co- 
processor 200 requests service (e.g., the value of a point, contents of a file,... or any 
information of the process control system 10) of the module CPU 38 through shared 
25 memory 202. The module CPU 38 then commimicates with the appropriate module to 
perform the requested service in a normal fashion. Once the response is obtained the 
infonnation is passed to the co-processor 200 via shared memory 202. Since the module 
CPU 38 is communicating via the LCN 120, the integrity of the LCN (i.e., the system) is 
maintained and similarly the module memory 40 caimot be corrupted by the co-processor 
30 . • 200. 

Also shown in Figure 5 is an example open system (or foreign system), for 
example, a Digital Equipment Corporation system which includes the DECnet network 
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and protocol and a DEC processor 300 attached to the DECnet network. In the prefeired 
embodiment, the communication between the DEC open system and the co-processor 200 
is via an X-windows protocol (X-windows beii^ a protocol defined by the Mass9chusetts 
Institute of Tedmology, Cambridge, Massachusetts) for grqjhical displ^ information, and 
5 other open systems standards being used for data exchange. Any requests of the outside 
system to the LCN is made via the co-processor 200 through the shared memory 202 to 
the module CPU 38 as described above. 

It is also desired to open up the graphics interface such that a display which is not 
on flie LCN can be displayed onto the CRT 151 of the US 122. This is achieved by the 

1 0 interface to the graphic card 150 fix>m the co-processor 200. Referring to Figure 6, there is 
shown a block diagram of the graphics card 1 50 of the preferred embodiment. The 
graphics card includes a card bus 1 52. Attached to the card bus 152 is a data memoiy 1 54 
^^di contains the information vMch is to be displayed onto the CRT, and also contains 
some control infoimation. A microprocessor 156 is also coupled to the card bus 152 and 

1 5 fiirfher is coupled to the module bus 36. A graphics processor 1 60 is coupled to the card 
bus 152 and performs all the processing for developing the information stored in the data 
memory 154, including some control functions. A shared memoiy 1 58 is coupled to the 
card bus 1 52. A connection is made &om the card bus 1 52 to the co-processor 200, 
thereby providing the interface mentioned above to the graphics card 150 6com the co- 

20 processor 200. The microprocessor 1 56 of the preferred embodiment of the graphic card 
150 is a Motorola 68020 processor. The graphics card 1 50 is a two port graphics card, one 
port of the graphics card being tied to the module bus 36 v/tdch is how a display is driven 
&om LCN. The LCN 120 provides a "single window to the process," i.e., a screen display 
of what the process/process control system is doing. The second port is coiq>led to the co- 

25 processor 200 and provides the windows interface for the universal station 122. The 

windows interface is the X-windows interface which is well defined and well known to 
those skilled in the art (the interface being defined by MIT, Cambridge, Massachusetts). It 
is through the interface from the co-processor 200 that all the window displays [i.e., the 
screen display(s) of the open system(s)] and windows controls are performed, including 

30 commands to the graphic card 1 50 to specify where to place the single window to the 

process on the screen of the CRT 151. The interface between the graphics card 150 and 
the co-processor 200 is the full windows interface. One of the windows is the display 
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refened to above as the "single window to the processor" (sometimes referred to as the 
LCN window). The co-processor 200 commands the graphics card 150 \diere the LCN 
window is to be placed on the CRT 151 and its relative size on the display. X-windows is 
a well defined protocol of how to commxmicate wi& the greQdiics card 1 50 (or any 
5 graphics canQ and display, and a computer permitting many windows to be displs^red. 
This includes displaying at least one window from the LCN and/or at least one window 
from the open system 300. In this system, a server is defined in X-windows as the 
m a ch i ne that is driving the display (or that portion of the co-processor 200 v^diich 
inter&ces to the gr^hics card 150), and a client is the application program, in the present 

1 0 embodiment, the DEC processor 300. 

The client 300 can have data which is desired to be displayed. The client 300 
communicates with the server portion of the co-processor 200 through an X-windows 
protocol indicating data to be displayed. The server portion of the co-processor 200 
commmiicates with the graphics card 1 50 through a device dependent layer (DDL) and is 

1 5 provided by the vendor of the graphics card, or in X-windows is via DDX protocol. The 
microprocessor 156 maintains the integrity of the card bus 152 into the data memory 154. 
The processmg of the data to be displayed on the CRT 151 is performed by the graphics 
processor 1 60. When a predetermined data screen is to be displayed, the microprocessor 
1 56 (which accepts requests fifom the LCN 120 via module bus 36) places the data in 

20 shared memory 158, and is subsequently processed by the graphics processor 160, and is 
then stored in data memory 154. When the open system 300 (via the client) desires to 
display some information, the information is communicated to the server portion of the co- 
processor 200 which then stores the information in the shared memory 158. The graphics 
processor 1 60 then processes that information and stores it in the data memory 154 for 

25 display. In that manner, and under the control of the graphics processor 1 60, the plurality 
of displays, i.e., windows, is displayed on the CRT 151 . 

It will be understood by those skilled in the art that the X-window protocol is 
essentially the open interface standard, the X-window protocol being readily available and 
well known to those skilled in the art In the preferred embodiment the UNIX operating 

30 system is utilized, the UNIX opoating system being able to run on many commercially 
available processors. Further information on the preferred embodiment of the graphics 
card 150 of the preferred ranbodiment of the US 122 can be had by reference to U.S. 
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Patent Numbers 4^490,797 and 4,663 »61 9, although it will be xmderstood that any graphics 
card can be utilized as discussed above. The graphics processor 1 60 of the preferred 
embodiment of the present invention is a Texas Instruments (TI) TMS 34020. The 
micropiDcessor ISiS and the module CPU 38 is a Motorola 68020. The co-processor 200 
S of the preferred embodiment of the present invention is a Motorola 68040, having bus 
C£q)abilityr with Ae other nucroprocessors of the system. It will be understood that a 
variety of processors can be utilized including a reduced instruction set processor which is 
available fiom Hewlett Packard among other processor manufacturers. 

Although the preferred embodiment utilizes the UNIX operating system, it will be 

1 0 recognized by those skilled in the art that any operating system can be utilized, including 
OSFl, Open Systems FoundationAJSA, Cambridge, Massachusetts. Although the co- 
processor 200 is controlling the display in the preferred embodiment the graphics card can 
also perform the display control. Since X-windows was readily available and performed 
the desired display control function, X-windows was utilized to take advantage of the 

1 S availability of the desired control function. It will be recognized by those skilled in the art 
that implementation of tiie present invention is not limited to X-windows, and that any 
protocol can be utilized. 

Thus it can be seen that the process control system 10 is open system permitting 
other system to interface into the LCN of the process control system and, because of the 

20 communication scheme as described above, the integrity of the process control system 1 0 
is maintained. Further, the graphics card ISO, although not in immediate control of the 
display unit ISl, guarantees that the gr^hic view (control view) to a field device (i.e., 
valve,...) or any other controls view of the process control system on the display unit is 
always maintained regardless of the operational state of the co-processor 200. If the co- 

25 processor 200 is rurming and controlling the display unit 151 (and in particular the actual 
display on the screen of the display unit 151) and a malfimction occurs or some other 
anomaly occurs to the co-processor 200, the fimction of the graphics card 150 guarantees 
that a single view of the process control system is maintained. As discussed above, the co- 
processor is cormected into the US 122 and has and controls a graphical interface through 

30 the display 151 and keyboard 153. 

Referring to Figure 7, which comprises Figures 7A and 7B, there is shown an 
example of two displays of the display unit 151. Figure 7A shows an example of a typical 
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nonnal display and Figure 7B shows a display vAicn an anomaly occtirs with the co- 
processor 200, or the iailbadc display. Figure 7A shows, for example, the windows which 
can be displ^ed. The windows always include a "view of the process", i.e., a control 
view fiom the process control system 10. Also included can be, for example, a window 
5 showing event history (a process control system application) coming fi:om an outside 
system, running a process control system q^plication, for example a DEC.computer 
system 300 as shown in Figure 5. Another window can be data coming from another 
outside computer system (not shown), for sample such as an Aj^le compiiter. This 
coirqputer system can be nmning another q)plication program referred to as documentation 

10 ^ the preferred embodiment of the process control syst^i the documentation of the 
process control system is created on an Apple computer). Still another window can be 
displayed, for example, lab data, coming fiom a Hewlett Packard computer system. The 
windows, except for the control view, are displayed on a single screen of the display unit 
151, the display information for these windows coming fiom a number of outside 

1 5 computer systems connected into the co-processor 200. If an error is detected with the co- 
processor 200, the method of the present invention guarantees that the display windows 
from the outside systems are inhibited and the control view is the only display shown and 
is zoomed to take up the entire screen of the display unit 151. This observation also serves 
as an indication to the operator that a malfiinction has occurred with the interface to the 

20 outside systems. 

The utilization of a low resolution touch screen system in a high resolution 
graphics enviroiunent, the method of the present invention, will now be described. The 
display of the preferred embodiment of the present invention has a 1280 by 1024 
resolution, i.e., 1280 pixels wide by 1024 pixels high. A single charact^ on the display is 

25 an 8 by 8 pixels character, and it is desirable to be able to position to a character. The 
touch screen system of the preferred embodiment of the present invention is an infirared 
technology having X coordinate and Y coordinate beams across the display v^ch are 
broken upon pointing to a desired position of the display. The pointing can be done by a 
finger (a pen, pencil, stylus,...) which breaks the beams. As is well known to those skilled 

30 in the art one side of the touch screen system includes LEDs and on the opposite side 

sensors arc placed which receive the signal fiom the LEDs. When the beam is broken a 
report is transmitted by the touch screen system to an information processing apparatus 
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identiiymg the coordinate inputs of the position desired. In order for a report to be 
transmitted, both an X beam and a Y beam must be broken. The present invention utilizes 
atouchscreenhavingaiesoliitionof 127 wideby 9Shigh. Thus for an 8 1^ 8 character 
size, a display resolution of 1280 by 1 024 has a xiesuhant target resolution of 1 60 wide by 
5 128 high. In ibis particular instance the target resolution is higher than the touch screen 
resolution, the touch screen resolution being 127 by 95. Thus the desired objective of 
being able to position to a chaxacter cannot be met 

In order to be able to achieve the desired objective of positioning to a single 
character, the display is zoomed in a predefined "window area" off to the side of the finger 

1 0 (or stylus) thereby permitting new data aroimd the zoomed up area to be drawn (displayed) 
and viewed. The character resolution around the repoited position displayed in the 
window area has a character resolution of 1 6 by 1 6. This results in a target resolution of 
80x64. As a result of the lower target resolution, the touch screen resolution of 127 wide 
by 95 high results in having at least one beam cross a character, being able to position to a 

1 5 desired character. 

The method of the present invention is implemented in the preferred embodiment 
wherein the graphics card 150 (more specifically, the microprocessor 156 and the graphics 
processor 160), sometimes refeired to herem as graphics controller, includes some logic 
and the co-processor 200 includes some logic (in the X-server portion of the X-windows 

20 protocol and extension of the X-senrer), the gr^hics card 1 50 and the co-processor 22 
operating together to obtain the improved display of the present invention. Referring to 
Figure 8 there is shown an overview of the operation of the method of the present 
invention. 

When a user of the open universal station 123 determines to select a target on the 
25 display 151, the operator points at that target on the &ce of the display 151. Whenthisis 
done, the touch screen system (or more simply referred to herein as display 151) detects 
the touching of the display 151 and reports tiie x*y coordinates of that touch to the 
grs^hics card 150. The gnq)hics card 1 50 then reports the touch screen coordinates to the 
X-server logic. Using this data the X-server logic computes the zoom region (sometimes 
30 referred to herein as the predefined "window area" or "window") and notifies the graphic 
card 150 of the bounding region and location in which to zoom the display, and tiie 
graphics card 1 50 zooms up the area around the x-y touch coordinates into this zoom 
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vdndow. Due to the inherent inaccuracy of the touch screen system • 
initial touch position is not directly over the desired target As a result, the operator will 
move the pointing device (finger, stylus^ pointer,...) until the touch position is over the 
desxred target This results is the touch screen system sending a xiewx-y coordinate to fte 
5 graphics card 1 SO. When these new coordinates are received, the grqihics card 1 50 

calculates new x-y coordinates to send to the X-server logic and zooms up the area around 
the new x-y coordinates into the zoom window. The location of the zoom window on the 
display remains fixed, but the data contained within the zoom window follows &e pointer 
as will be described in more detail hereinunder. This process continues until the pointing 

1 0 device is removed fiom the touch screen system. When the removal of the pointing device 
is detected, the touch screen system sends an exit code to the graphics card 150. Upon 
receipt of this signal, the graphics card stops zooming data into the zoom window, and 
passes the exit code to the X-server logic. When the X-server logic detects the exit code, 
it removes the zoom window and the image that was covered by the zoom window is 

15 restored. 

When the server logic starts up, the zoom feature is included as part of the start up 
procedure by the operator. If the zoom feature is not initialized, then the touch screen 
zooming fiinction is disabled. If the zoom feature is started, then a zoom window of 
setable size and location, i.e., programmable, is defined. The operator indicates the size of 

20 the zoom region by height and width, indicates the x-ofiTset and y-offset, and indicates 

vsiietfaer the operator is standing or sitting, right handed or left handed,.... In this fashion 
the zoom window will be presented in the most unobstructed manner, i.e., the zoom 
window will be unobstructed iBrom the operators view as determined by the inputted 
initialized information. The cursor position is defined as the center of the zoom region and 

25 is not displayed when the display is in a zoom mode. When the finger is removed and the 
zoom region is deleted, the cursor will appear in its proper position on the display. 

Referring to Figure 9, which comprises Figures 9A and 9B, there is shown a flow 
diagram of the logic of the graphics card 150 for implementing the method of the present 
invention. When the finger (or stylus) is inserted onto the touch screen such that an X and 

30 Y beam are broken (block 41 0), a report is received by the information handling apparatus, 
in the preferred embodiment the graphics processor 160 of the process control system 10. 
Upon the first entry of the finger or stylus onto the display screen, the report also indicates 
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that this is an entry report (block 415). The graphics processor 160 checks to verify 
vv^ether tfiis is the first rqxxrt (block 420) and if it is sets a first report flag (block 42S). 
The X and y positions (T/Sx aiKl T/Sy) fiom the touch screen system is accepted by the 
graphics processor 1 60 (block 430). The gr^hics processor calculates the actual soeen x 
5 and y coordinates, ACTx and ACTx, utilizing the touch screen (T/S) positions from the 

touch screen systems (block 435). Actual coordinates are determhied using the equations; 
ACTx = T/Sx* 10.15 
ACTy = T/Sy* 10.88. 
These positions, i.e., the T/S positions and actual positions are saved (block 440), 
10 and the actual positions are sent to the co-processor 200 (block 440). If the zooming touch 
feature is disabled, the processing proceeds to block 410 (block 444). If the zooming 
touch feature is enabled (block 444), a "zoom up around touch" flag is set (block 445) and 
the processing proceeds to block 410. 

A report is transmitted to the graphics processor 1 60 by the touch screen system 
1 5 about every 1/1 6 of a second, i.e., 1 6 reports per second. Since the initial report, as a 

result of placing the finger onto the touch screen, may not result in identifying the desired 
character, the finger or stylus may be moved. On each subsequent report, since the finger 
or stylus is still on the screen, the exit report check of block 415 will indicate a no; 
however, the first report determination will also be a no thus proceeding to block 446. 
20 The graphics processor 1 60 determines if the zoom touch and the zoom window are 

enabled (blocks 446, 447). If neither are enabled, the processing proceeds to block 430. If 
both are enabled the process proceeds to block 450. The new area to be zoomed around as 
the pointer is moved is now calculated. The T/Sx, T/Sy, coordinates and accepted (block 
450) and XDIFF and YDIFF coordinates are calculated as follows: 
25 XDIFF = (INTIIAL T/Sx - T/Xx) * 5.08 

YDIFF = (INITIAL T/Sy - T/Sy) * 5.44 (block 455). 
The center of the screen X, Y coordinates which are to be zoomed around is 
calculated (block 456), and transmitted to the co-processor 200 (block 457). The 
processing then proceeds to block 445. The characters are zoomed to a 16 by 16 pixel size 
30 and showing approximately a 20 by 20 character (depending on the size of the 

programmable zoom region) around the new center position. Thus, as the finger or stylus 
is moved, the zoomed area follows the stylus at half the distance (or half the "speed") such 
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that ultimately the desired character is pointed to by the finger or stylus. An exan^>le of 
the half speed display of the zoomed area is sho^ in Figures 1 OA and 1 OB, A^ch 
conqfTiises Figure 1 0. RecaU that in all cases the zoomed region remains fixed in location 
on the display screen. 'When the desired (or target) character is pointed to by tiie cursor, 
5 Le^ in the center of the zoom region, in the preferred embodiment, the finger or stylus is 
withdrawn. 

When the finger or stylus is withdrawn, the touch screen systmi transniits an exit 
rq)Qrt to the gr^hics processor 1 60 and the gn^hics processor clears the first report flag 
(block 485), sends and exit code to the co-processor 200 (block 481), and checks to see if 

10 the zoom window was enabled (block 482). If the zoom window has not been enabled the 
processing proceeds to block 410. If the zoom window was enabled the cursor is restored 
(block 483), and the processing {Proceeds to block 410. 

At block 410, the graphics processor is waiting to receive reports. If no report is 
received the graphics processor proceeds to determine if the zoom up around touch flag 

15 was set (block 490), shown in Figure 9B. Iftheflag was settfae graphics processor 160 
determines if the zoom window has been enabled (block 492). If neither condition is met 
the processing repeats itself at block 410 and is in a constant wait loop. If both conditions 
are met the graphics processor clears the zoom up around touch flag (block 494), obtains 
the zoom window parameters fix>m the co-processor 200 (block 496), and the zoom up 

20 area around the actual screen x-y touch coordinates are placed into the zoom window 
(block 498). The processing then returns to block 410. 

Referring to Figure 12 there is shown a partial display screen showing row 1 of 
characters 16 through 19. The X position pixels and Y position pixels of the display 
screen are also shown for the pertinent characters. The touch screen apparatus includes 

25 only the X beams (but will also apply for the Y beams although not shown). Beams 12, 

13, and 14 are shown intersecting characters 16, 18, and 19. This is because the resolution 
of the touch screen apparatus as mentioned above is lower than the target resolution, 
assuming for purposes of example here that the target character is character 17. With a 
touch screen resolution of 127 by 95 pixels for the touch screen and a target resolution of 

30 1 60 by 128, the beams can only cross approximately one ovd of every ten pixels. Thus for 
a character having 8 pixels tiiere will be a number of characters which will not have an 
intersecting or crossing beam. Referring to Figure 1 3, there is shown a partial zoomed 
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area of the display of Figure 12. Generally the finger or stylus will break 2 or 3 beams, 
rarely 4 beams in each direction. Lefs assume for purposes of example that X beams 12, 
13, and are broken, character 1 7 being the character attempted to pointed to (i.e^ the 
ik9redxibaracter)/lheX coordinate position for beam 13 is transmitted as the actual T/Sx 
5 coordinate value. 

According to the present invention, character 1 8 will be the "pointed to" character 
such that character 18 will be zoomed to a 16 by 16 character size (including 
approximately 20 by 20 characters aroimd that initial position according to the jiresent 
invention). Since character 17 is the desired character, as the finger is moved towards 
1 0 character 1 7 the character will sppear in the zoom region under the cursor in the zoom 

region. At a point in time when character 17 is on the cursor, the finger is withdrawn. The 
beam positions are transmitted to the processing device which calculates the x, y screen 
coordinates which identifies character 17. When the finger is withdrawn the display is 
restored to its original. 

IS Referring to Figure 1 1, which comprises Figures 1 1 A and 1 IB, there is shown a 

flow diagram of the X-server logic of co-processor 200, which operates in conjunction 
wifli the graphics card logic, to generate the display, and specifically to generate the 
window of the display 15 1, in the preferred embodiment of the present invention. Figure 
1 1 A shows the event handler of the X-server logic, including events, i.e., inputs, vMch are 

20 received fi-om the open US 123 namely, keyboard inputs, mouse inputs, touch screen 

inputs,.... Generally, when the display is in a zoom mode, and an input is received fix)m 
other than the touch screen, the zoom window is removed firorri the screen, and the display 
restored to a normal display without the window. When an event is received from the 
touch screen and is a coordinate event (i.e., not including the exit code), the logic of block 

25 501 is activated. When the event is a touch screen exit code, the logic of block 51 1 is 
activated. 

Referring to Figure 11 B, a more detail flow chart of the touch screen event 
processing in co-processor 200 is showiL If the zoom feature is enabled (block 502) and 
the zoom window has not been mapped to the display (block 503), the window is 
30 generated. The size and position of the zoom window are determined (block 504), and the 
zoom window is mapped to the display (block 506). The information (i.e., parameters) of 
the zoom window are passed to the graphics card logic 150 (or sometimes referred to as 
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the graphics controller (G/C)) (block 507), and the graphics controller is informed that the 
zoom window is enabled (block 508). The logic then continues to block 521 . 

If the touch screen event includes an exit code (block 520), then the logic of block 
.511 isactivated in \^ch the window is removed fiom the display. If the zoom window is 
5 mapped to the display (block 512), the zoom window is unmapped £rom the display (block 
5 14X and the graphics controller is informed that the zoom window has been disabled 
(block 516). Thus the zoom window is removed fiom the screen. If the zoom window has 
not been mapped to the display (block 512), the X-server logic sends the new cursor 
location on into the server for further processing (block 521 ). In this marmer the X-server 

1 0 logic generates or removes the zoom window fiom the display and indicates to the 

graphics controller logic Aether the zoom window is enabled or disabled. The graphics 
controller logic subsequently places the zoomed data within the zoom window in 
accordance with the method of the present invention described above. 

It will be understood by one skilled in the art that although some of the figures 

15 show the zoom window above and to the left offte points, the pointer may be in other 
relative locations, such as above and to the right, below and to the left, below and to the 
right of the pointer. The location of the window relative to the pointer is programmable 
fiom the data entered by the operator as described above. Further, it will be understood by 
one skilled in the art that vAien the pointer enters the display at the upper left hand comer 

20 and the window is programmed to be above and to the left of the pointer, the logic will 
invert the zoom window location such that it appears on the screen, i.e., below and to the 
right of the pointer. Similarly when the pointer enters the display at an upper edge, the 
window will appear below the pointer. When the pointer enters the upper right comer of 
the display, the window is placed below and to the left,.... 

25 While there has been shown v/bat is considered the preferred embodiment of the 

present invention, it will be manifest that many changes and modifications can be made 
therein without departing firom the essential spirit and scope of the invention. It is 
intended, therefore, in the armexed claims to cover all such changes and modifications 
which fall within the true scope of the invention. 
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CLAIMS 

1) A method for selecting a character being displayed on a display using a pointer 
elemCTt, herein the display has a first resolution and a touch screen system associated 
' wi& the display has a second resolution, and wherdn the character has a third resolution 
5 resulting in a target resolution, and further wherein the target resolution is higher than the 
resolution of the touch screen system, the touch screai system transmitting to a data 
processing unit processing the display, an X and Y coordinate signal of the character 
pointed to, the method comprising the steps of: 

a) when a character is pointed to, accq>ting an initial X and Y coordinate 

1 0 value from the touch screen system, the pointer element having a current pointer location; 

b) calculating a corresponding X and Y coordinate value of the display; 

c) saving the initial X and Y coordinate values and the corresponding 
calculated X and Y coordinate values; 

d) zooming the display a predetermined number of characters around the 
1 5 initial X and Y coordinate values into a zoom window, the zoom window having a 

predetermined size and having a predetermined location relative to an initial entry point of 
the pointer element; 

e) if the character to be selected is not coincident with a cursor, the cursor 
being displayed in the center of the zoom window, 

20 i) moving the pointer element from the current pointer location to a 

new current pointer location towards the character to be selected, otherwise 
ii) proceeding to step (j); 

f) while the pointer element is being moved towards the character to be 
selected, continxiing to accept updated X and Y coordinate position values of the current 

25 pointer location on a periodic basis; 

g) calculating a new center point of the display in the zoom window, the new 
center point following the pointer element at a predetermined distance with respect to the 
distance of the pointer element; 

h) providing the predetermined nimiber of characters around the new center 
30 point to be displayed in the zoom window; 

i) repeating the method from step (e) until the character to be selected is in 
the center of the zoom window; and 
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j) withdrawmg the pointer element, the new center point calculated fit>m step 
(g) having the X and Y coordinate values of fte character to be selected, thereby 
permitting a desired character to be selected when the target resolution is higher than the 
resolution of the touch screen system. 

5 

2. A method for selecting a character according to Claim 1 , wherein the step of 
zooming comprises the step of: 

zooming each character within the predetermined number of characters aroimd the 
initial X and Y coordinate values wherein each of the zoomed characters has a fourth 
1 0 resolution, such that the resultant target resolution is less than the resolution of the touch 
screen system, thereby permitting a predetermined character to be selected. 

3. A method for selecting a character according to Claim 2, wherein the fourth 
resolution, the resolution of the zoomed characters, is tv^ce the third resolution, the 

1 S resolution of flie characters displayed on the display. 

4. A method for selecting a character according to Claim 3 wherein the 
predetermined number of characters zoomed around the initial X and Y coordinates is 20 
characters by 20 characters. 

20 

5. A method for selecting a character according to Claim 1,'wherein the step of 
calculating a new center point to zoom the display, generates the new center point 
coordinates from the current pointer location to a relative position from the initial X and Y 
coordinate value, the relative position being a factor less than one, such that as the pointer 

25 element is moved the desired character ultimately gets to a position in the zoomed display 
wherein the cursor is coincident with the desired character. 

6. A method for selecting a character according to Claim 2, wherein the step of 
calculating a new center point to zoom the display, generates the new center point 

30 coordinates from the cimient pointer location to a relative position fix)m the initial X and Y 
coordinate value, the relative position being a factor less than one, such that as the pointer 
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element is moved the desired character ultimately gets to a position in the zoom window 
wherein the cursor is coincident with the desired character. 

7. A mefliod for selecting a character according to Claim 5, ^^n^ierein the factor used to 
S determine the relative position of the new center point is one half. 

8. A method for selecting a character accordiiig to Claim 7, wherein the 
predetermined size of the zoom window is programmable. 

10 9. A method for selecting a character accordmg to Claim 8 wherein the 

predetermined location of the zoom window is programmable such that the zoom window 
is viewable and unobstructed from view. 

1 0. A method for selecting a character according to Claim 9 wherein the 
1 S predetermined location of the zoom window remains in a fixed predetermined location as 
the pointer element moves over the display. 



wo 94729788 



PCTAJS94/0fi755 



1/19 



cm' 



T 




O T— 


1— 

UJ 

_J 

o 


AM 


^ ST N 


o 
1- 

2 
< 


US 



T 

o 

CO 



CM 
O 
CO 



<x 
o o 

X 



<N 



O 

z> 




lYO 9409788 



PCT/DS94y06755 



2/19 




wo 94/29788 



PCT/US94/06755 









lO 

$ 


DC 


>- 
_l 




Q. 




Q. 


o 

Q. 


SU 



o o 

CD CM 

to o 



GO 



3/19 



CD 

I 



O 



LU 
I— 

to 
m 

(/) 



I 



o 



Q. 
O 



o 



i 



I 



oqq: W 
o z ^ 



3 



CL I 

o in 



o 
c/) 
in 

o 
o 

or: 

CL 



O 

1 



2 














DRI 


ZD 

in 



MODULE BUS 



I 



— o 

UJ iL 



T 



o a: 

< </) 

X o 
in UJ 







o 








TIMI 


RECEI 



in 
in 



q:: = 
o 



T 



O 



^ in 



t 

CD 

in 



a: 



or ^ 



< 
or 



CM 

to 



—I — 



2e 

UJ 

IT 



I ujQt: 
z m ^ 



< UJ 



wo 94/29788 



PCT/US94/06755 



4/19 



1 OPEN US-123 



122 


200 

$ 


US 




COPROCESSOR 





LCN 



120 



UCN 
K/^14 



TCP/IP 
OSI 
DEC NET 



Fig. 4 



W0 94A29788 



PCT/US94/067S5 



5/19 



US-122 



36-^ 




120 



40 

1. 

MODULE 
MEMORY 



38 

A. 



MODULE 
CPU 



202 
<> 



SHARED 
MEMORY 



150 



,^ GRAPHICS 
CARD 



LCN 



/displayN 

151 



123 



/ 



(DDL) 



2^0 



COPROCESSOR 



(CUENT) 7 

/ 
/ 
/ 
I 



(SERVER) — / 



KEYBOARD 
(KB) 



X-WINDOWS 
PROTOCOL 



n/^153 



DEC NET 




DEC 
PROCESSOR 
(CUENT) 



x/^300 



Fig. 5 



wo 94/29788 



PCT/US94/06755 



O 
O 
CM 

I 

q: 

O 
O 



6/19 




wo 94/29788 



PCTAJS94/0(?755 



7/19 



CONTROL VIEW 
(FROM THE PCS 
10) 



EVENT 
HISTORY 
(DEC 300) 



LAB DATA 
(HP) 



DOCUMENTATION 
(APPLE) 



Fig. 7 A 



CONTROL 
VIEW 



V 



7 



Fig. 7B 



wo 94/29788 



PCT/DS94/06755 



8/19 



ABCD 
EFG 
PQ 
1234 



\ 




ZOOM RFGION 



RSTUVW 



A 



ABXVl /123456 
I 7890AB 



^XWY 




GRAPHICS 




CARD 








$ 






150 


COPROCESSOR 



200 



Fig. 8 



wo 94/29788 



PCTAJS94/06755 




wo 94/29788 



PCT/DS94/06755 



10/19 



in 

GO 







III 




FIRST 
ORT 


5 


SEND EXIT CODI 




CLEAR 
REP 

FL, 














wo 94/29788 



PCT/US94/0675S 



11/19 



1^ 



( 


(457) 


SEND 
ACTUAL 
X-Y COORDINATE 




) 





lO 




PCTAJS94/067S5 




GET ZOOM 
WINDOW 
PARAMETERS 



(496) 



ZOOM UP AREA 
AROUND ACTUAL 
SCREEN X-Y TOUCH 
COORDINATES INTO 
ZOOM WINDOW 



(498) 



Fig. 9B 



wo 94/29788 



PCr/US94/067SS 




13/19 

ZOOM WINDOW 



DISPLAY SCREEN 



ABCDEFGHIJKL 
>;5^0PQRSTUVWX 

INITIAL // 
POSITION -MOVE 



Fig, 10A 



ZOOM WINDOW 




ABCDEFGHIJKL 
MNOPQR^^VWX 




CURRENT 
POSITION 



Fig. 1 0B 



wo 94/29788 



PCTAJS94/0S755 




wo 94/Z9788 



PCT/DS94/06755 



^ 15/19 
\ — 




wo 94/29788 



PCT/DS94/06755 



16/19 



.2^ 




<5) 



wo 94/29788 



PCr/OS94/06755 




wo 94/29788 



FCrAJS94/06755 



rig. 12 



18/19 

TOUCH SCREEN APPARATUS 



Y-POSmON PIXELS 



Ii2|3|4|5|6|7l8i9h0|llh2h3h4h5h6h7|j 



1024 



120 



127 



X- 

posmoN 

PIXELS 



149 



150 



151 

152 




V ROW 1 \' 
s CHARACTER 



19^ 




BEAM#12 



DISPLAY 
SCREEN 



BEAM#13 



BEAM#14 



1280 



wo 94/29788 



PCT/US94/06755 



19/19 






INTERNATlONAi. SEARCH 


REPORT 


tn ^'onal Applicaoon No 

PCT/US 94/06755 


A. CXASSIFICATION OF SUBJECT MATTER 

IPC 5 G06F3/033 








Accordiog co IntEtnaaonal Paxeni Qasnftcation (IPC) or to both naoonal dassHcation and IPC 






B. FIELDS SEARCHED 








IPC 5 


G06F 








Documcaxa&oo searched odicr fhan minimuxn documentation to the extent that such doctancncs are inchidfd in the fields searched 


Elec&tmiG data base consulted during (he tnteroa&onai search (name or data base and* where practtcal, search tenns used) 


C. DOCUMENTS CONSIDERED TO BE RELEVANT 


Category ' 


Citatioo of document, with tndicadon, where appropnaie. of the rdevant passages 


Relevant to daim No. 


A 


IBM TECHNICAL DISCLOSURE BULLETIN 

vol. 26, no. 5 , October 1983 . NEW YORK 

US 

pages 2620 - 2621 

A.G. COLE AND R. H. RIEKERT 

'Touch-sensitive overlay selection 

repeater' 

see the whole document 




1.5,6 


A 


PATENT ABSTRACTS OF JAPAN 

vol. 013, no. 271 (P-889)22 June 1989 

& JP.A.Ol 064 062 (HITACHI LTD) 9 March 

1989 

see abstract 




1-3 


j }(j Further documents are listed in the continuation of box C. 


[)( 1 Patent family o 


[icmbcn are listed in annex. 


* Special categories of dted dooxmeoB : 

'A' defining the general sutt of the art which is not 

oonadex«d to be of pamcular relevance 
'E* eartier docummt but published on or alter the interoanona] 

filing date 

*L* document which may throw doubts on priority daun(s) or 
«^ch is dted to cstaUish the publicaaon date of another 
dtabon or ocher ipedal reason (as ^cdficd) 

'O' docxoBent refemng Co an oral disdosure, use, exhibition or 
other means 

'V doonnent published pnor to the mtema&onal filing date but 
Later than the pnoricy date rlaimrd 


T* later docummt published after the international filing date 
or pnonty date and not in conflict with the appUcanon but 
oted to undexnand the pzxnciplc or theory muMriymg die 
tnvennon 

*X* document of particular rcievattce; the datmed invention 
cannot be cotwidcrcd novel or cannot be considered to 
involve an inventive step when the docimient is talcen alone 

-y* docummt of pardcular rdevance; the daixned tavendon 
cannot be considered to involve an inventive step when die 
document is combined with one or more other such doci^ 
nr^^i such combinatioB being obvious bo a person 
in the art. 

document member of the same patent family 


Date of the 


icnial completion of the intemanonal search 


Date of mailing of the international search report 


17 October 1994 


la It 94 




Name and tnailing address of die (SA 

European Patent Office, P3. SSI 8 Patcndaan 2 
NL . 22SO HV Riiswijk 
Td. (r 31.70) 340-2040. 1^ 31 6SI cpo ni. 
Fas (-1- 31-70) 340-3016 


Auihanzed officer 

Bravo, P 



Feira PCT/ISAmO CtacDBd i&eBg (taty 1992) 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



1 Aiqslicatioa No 

PCT/US 94/06755 



C^Commuadoii) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ' Qtalioa of <locumcnK. wttt indxcaaoa. where apptopnate. of the relevant pasuges 



Relevant to claim Nol 



p.x 



MOTOROLA TECHNICAL DEVELOPMENTS 

vol. 15 , May 1992 , SCHAUMBURG, ILLINOIS, 

US 

pages 49 - 56 

B. JOHNSON AND G. RAPPS 'CYCLOPS: a one 
button alpha-numeric keypad' 
see page 49, left column, line 36 - right 
column, line 18; figures 2,3 

PATENT ABSTRACTS OF JAPAN 

vol. 008, no. 211 (P-303)26 September 1984 

& JP,A,59 094 135 (MITSUBISHI DENKI KK) 30 

May 1984 

see abstract 

EP.A.O 326 751 (SPERRY MARINE INC.) 9 
August 1989 
see abstract 

EP.A.O 575 146 (HONEYWELL INC.) 22 

December 1993 

see the whole document 



1.2 



1-3 



1-10 



Fom fCr/ISA/310 (eodisaMtai of (MDStf HUM) Italy l*n| 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 

Knfonmtion on patent fannly iRtmbcrs 



bite. onal Appfirnttoa No 

PCT/US 94/06755 



Patent (iocument 
died in sevch report 



Publication 
dale 



Patent family 
nicnibcr(i) 



PubCsstian' 
date 



EP-A-0326751 



EP-A-0575146 



09-08-89 



DE-D- 
JP-A- 
JP-B- 
US-A- 



3851322 
1226020 
6023946 
5053758 



06-10-94 
08-09-89 
30-03-94 
01-10-91 



22-12-93 



AU-B- 4013693 



23-12-93 



Foxm PCT/tSA/310 (psxent&mily scabx) Italy 1993) 



